SEMI-AUTOMATED MEASUREMENT OF ANATOMICAL STRUCTURES USING 
STATISTICAL AND MORPHOLOGICAL PRIORS 

Field of the Invention 

The present invention is directed to a system and method for measuring anatomical 
5 structures in medical images, such as those generated by magnetic resonance imaging (MRI), 
computed tomography (CT), positron emission tomography (PET), etc, and more particularly 
to a system and method in which the measurement is semi-automated and makes use of 
statistical and morphological priors in the form of user-defined exemplars, seed regions, 
shape models, or other guiding information. 
10 Description of Related Art 

Accurate identification and measurement of various anatomical structures is a vital 
tool both for surgical planning and for evaluation of disease progression and patient response 
to therapy for numerous diseases. Measurement of hippocampal volume is an important 
endpoint for diagnosing and monitoring both intractable temporal lobe epilepsy and 
15 Alzheimer's disease. Identification of the aorta and associated vessels and measurement of 
various related parameters are vital tools for evaluation of abdominal aortic aneurism 
progression and response to treatment. Measurement of the spinal cord and associated 
cerebrospinal fluid can be an important tool for surgical planning. 

Current standard methods for obtaining these data points are largely manual and 
20 subjective, and are therefore both error-prone and subject to inter- and intra-operator 
variability. In addition, manual tracing of structures such as the vascular system, which may 
appear on up to 800 images in a single study, requires both considerable expertise and a great 
deal of time. Significant research effort has been devoted to the subject of identification of 
curvilinear and poorly defined structures in medical images, but there is at this time no 
25 generally accepted solution. 
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de Bruijne et al. (M. de Bruijne, W. Niessen, J. Maintz, M. Viergever, "Localization 
and segmentation of aortic endografts using marker detection," IEEE Trans. Medical Imaging 
22(4), pp. 473 - 482, 2003) have demonstrated a method for identifying aortic stents after 
surgery through use of radio-opaque markers sewn into the stent prior to surgical 
implantation. 

Ashton et al. (E. Ashton, K. Parker, M. Berg, C. Chen, "A novel volumetric feature 
extraction technique, with applications to MR images," IEEE Trans. Medical Imaging 16(4), 
pp. 365 - 371, 1997) and Hsu et al. (Y. Hsu, N. Schuff et al., "Comparison of automated and 
manual MRI volumetry of hippocampus in normal aging and dementia," Journal of MM 16, 
pp. 305 - 310, 2002) have presented semi-automated methods for the identification and 
measurement of the hippocampus. 

Ashton et al. (E. Ashton, S. Totterman, C. Takahashi, J. Tamez-Pena, K. Parker, 
"Automated measurement of structures in CT and MR imagery: A validation study." Proc. 
IEEE Symposium on Computer-Based Medical Systems, pp. 300 - 306, 2001) have presented 
a method for identification and measurement of structures with simple (ovoid) shape, such as 

solid soft-tissue tumors. 

Taylor and Barrett (D. Taylor, W. Barrett, "Image segmentation using globally 
optimum growth in three dimensions with an adaptive feature set." Visualization in 
Biomedical Computing 1994, pp. 98 - 107, 1994) have presented a method for segmentation 
of structures using competitive region growth without any a priori shape constraint. 

Carlbom et al. (I. Carlbom, D. Terzopoulos, K. Harris, "Computer assisted 
registration, segmentation and 3D reconstruction from images of neuronal tissue sections," 
IEEE Trans. Med. Imaging, pp. 351 - 362, 1994) have presented a method for application of 
deformable templates to segmentation of neurological structures. 
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Numerous researchers, including Cohen (L. Cohen, "On active contour models and 
balloons," CVGIP: Graphical Models Image Processing, pp. 21 1-218, 1991) and Chung (R. 
Chung, C. Ho, "3-D reconstruction from tomographic data using 2-D active contours," 
Computers and Biomedical Research, pp. 186 - 210, 2000) have demonstrated the use of 2-D 
5 active contours (snakes) and their derivatives in providing edge-based structural identification 
in medical images. 

Sato et al. (Y. Sato, S. Nakajima, N. Shiraga, H. Atsumi, S. Yoshida, T. Roller, G. 
Gerig, R. Kikinis, "Three-dimensional multi-scale line filter for segmentation and 
visualization of curvilinear structures in medical images," Medical Image Analysis, pp. 143 - 
10 168, 1998) have described a segmentation method geared towards vascular and other 
curvilinear structures using a hierarchical filtering approach. 

Aylward and Bullitt (S. Aylward , E. Bullitt, "Initialization, noise, singularities, and 
scale in height ridge traversal for tubular object centerline extraction," IEEE Trans. Med. 
Imaging, pp. 61 - 75, 2002) have proposed a method for identifying the center line of 
1 5 structures such as the vascular system. 

Krissian et al. (K. Krissian, G. Malandain, N. Ayache, R. Vaillant, Y. Trousset, 
"Model-based detection of tubular structures in 3-D images," Comput. Vis. Image 
Understanding, pp. 130 - 171, 2000) have demonstrated a method for identifying tubular 
structures such as the abdominal vasculature using a shape model approach. This approach 
20 and those described in the previous two references work well as long as the shape 
assumptions are valid. However, they have difficulty when these assumptions break down, as 
at bifurcations. In addition, these methods are not able to identify associated structures such 
as thrombus or calcifications, and have not been demonstrated to be effective in cases where 
significant artifacts are present, as in post-aortic endograft CT images. 
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Other methods that are able to segment aortic vessel boundaries but not thrombus, and 
which have significant difficulty with bifurcation points and tortuous vessels include: 

O. Wink, W. Niessen, M. Viergever, "Fast delineation and visualization of vessels in 
3-D angiographic images," IEEE Trans. Med. Imaging, pp. 337 - 346, 2000. 

B. Verdonck, I. Bloch, H. Maitre, D. Vandermeulen, P. Suentens, G. Marchal, 
"Accurate segmentation of blood vessels from 3D medical images," IEEE Int. Conf. Image 

Processing, pp. 311 - 314, 1996. 

M. Fiebich, M. Tomiak, R. Engelmann, J. McGilland, K. Hoffman, "Computer 
assisted diagnosis in CT angiography of abdominal aortic aneurysms," Proceedings ofSPIE 

vol. 3034, pp. 86-94, 1997. 

A. Bulpitt, E. Berry, "Spiral CT of abdominal aneurysms: comparison of 
segmentation with an automatic 3D deformable model and interactive segmentation," in 
Proceedings ofSPIE vol. 3338, pp. 938 - 946, 1998. 
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Summary of the Invention 

There is a need for a fast, accurate, and precise system and method for the 
identification and measurement of tortuous, curvilinear, or bifurcating structures in medical 
images. It is therefore an object of the invention to provide such a system and method. 
5 It is another object of the invention to provide such a system and method that operate 

rapidly and accurately. 

It is still another object of the invention to provide such a system and method that 
minimize both intra-operator and inter-operator variation. 

It is yet another object of the invention to provide such a system and method that can 
10 be adapted to the identification of a wide variety of normal and abnormal biological 

structures in medical images. 

To achieve the above and other objects, the present invention is directed to a method 
for automating the identification, delineation, and measurement of various anatomical 
structures in medical images. This method makes use of three types of information: (1) 

15 Statistical description of the various tissue types present in the images. This information is 
obtained automatically through the use of a maximum likelihood classifier. (2) Statistical 
description of the tissue of interest. This information is obtained by making use of an 
anatomical atlas or user input - typically a small seed region or an exemplar. (3) 
Morphological description of the structure of interest. This information is taken from an a 

20 priori shape model and/or one or more user-defined exemplar regions. 
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Brief Description of the Drawings 

A preferred embodiment of the present invention will be set forth in detail with 

reference to the drawings, in which: 

Fig. 1 shows a flow chart of operations of the preferred embodiment; 

Figs. 2A-2C show the location of lumen in an initial launch image and in a subsequent 

image; 

Figs. 3 A and 3B show raw images of the hippocampus; 

Figs. 4A-4C show sample images used to locate the hippocampus in an experimental 
verification of the preferred embodiment; 

Fig. 5 shows a plot of experimental results obtained from the image data of Fig. 4A; 
Figs. 6A and 6B show further experimental results; and 

Fig. 7 shows a schematic diagram of a system on which the preferred embodiment can 
be implemented. 
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Detailed Description of the Preferred Embodiment 

A preferred embodiment of the present invention, and experimental results therefrom, 
will now be set forth in detail with reference to the drawings. 

Fig. 1 shows a flow chart of the operational steps of the preferred embodiment. In 
step 102, data of an image or a sequence of images are input from a suitable source, e.g., a 
storage medium on which MRI data have been stored. 

The maximum likelihood classification (MLC) of step 104 refers to the process of 
optimally separating an image into areas of similar statistical behavior. It is assumed that 
regions of similar statistical behavior will correspond to different tissue types. The goal of 
the MLC algorithm used in this invention is to globally maximize one of the following 
discriminant functions: 

gi (x) = In | Pi | -|ln | R; | ~{x - m$ R: x (x - m,) (1) 

where R t is the covariance matrix for class i, m f . is the mean vector for class i, p, is the a 
priori probability of class i appearing at the voxel under consideration, and x is the value 
vector describing the voxel under consideration. This discriminant function is applied to 
cases where a priori probabilities are available and tissue classes are expected to have 
different covariance matrices. 

gi (x) = -In | R, | -(* - mjRT'ix - m f ) (2) 
where R. is the covariance matrix for class i, m. is the mean vector for class i, and x is the 
value vector describing the voxel under consideration. This discriminant function is applied 
to cases where a priori probabilities are not available and tissue classes are expected to have 
different covariance matrices. 

g i {x) = -{x-m i ) t R;\x- m t ) (3) 
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where R. is the covariance matrix for class i, m i is the mean vector for class i, and x is the 

value vector describing the voxel under consideration. This discriminant function is applied 

to cases where a priori probabilities are not available and tissue classes are expected to have 

similar or identical covariance matrices. 
5 Discriminant maximization is accomplished using one of several known optimization 

techniques, such as alternating estimation (AE), iterated conditional modes (ICM), or 

simulated annealing (SA). 

The statistical description (mean and covariance matrix) of the tissue or structure of 

interest is obtained through identification of a seed or exemplar region, as input in step 106. 
1 0 This may be accomplished through use of a co-registered anatomical atlas, or by making use 

of a user's input via a mouse click on a particular location, a manual outlining of a particular 

structure on one or more images, or the use of a semi-automated method for exemplar 

delineation on one or more images. 

The morphological description of the region of interest is derived in step 108 from the 
1 5 exemplar or seed regions provided by either a user or a co-registered anatomical atlas. If an 

atlas is used, the morphological description is taken from the shape of the structure in the 

atlas. If exemplar regions are used, a flexible three-dimensional surface is fit to the 

boundaries of the exemplar regions. The three dimensional surface may be generated using 

spatial interpolation, curve fitting, spatial warping, or other appropriate methods. This 
20 surface serves as the morphological description of the structure of interest. If a single click or 

seed region are used, the structure is assumed to be ovoid in cross-section with no assumption 

as to the shape out of plane. 

Structural identification is carried out in step 110 on an image-by-image basis. If 

exemplar regions are used, the images on which they appear are used to seed this process. If 
25 a single click seeding is used, a semi-automated region identification process such as that 
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described previously (Ashton, 1997) is used to identify the structure on the initial image, and 
that image is then used to seed the structural identification process. 

Once the structure of interest has been identified on a given image, a test is applied to 
determine if the structure should be continued into adjacent images. Each included voxel is 
5 shifted based on the direction of the main axis of the morphological model. The discriminant 
function given in Equation (1), (2) or (3) is then applied to determine if the corresponding 
voxel on the adjacent image is more likely a member of the structure class or of the 
background class to which it is currently assigned. If a sufficient number of voxels on the 
adjacent image are included, the structure is assumed to continue into that image. 

10 Included voxels are then grouped spatially, and a determination is made as to whether 

the resulting distribution is better described by one or two spatial clusters. If two spatial 
clusters better describes the distribution, that image is marked as a bifurcation point and two 
separate regions are propagated from that point forward. 

This process is illustrated in Figs. 2A-2C. In Fig. 2 A, the dark outline indicates an 

15 identification of lumen on the initial launch image. In Fig. 2B, the dark outline indicates a 
minimum size contour drawn around those points from the initial image that have 
successfully passed through to the subsequent image. In Fig. 2C, the dark outline indicates 
the final identification of lumen on the subsequent image. 

Once a single pass of this process is complete, the user is able to review the results of 

20 the automated structure identification in step 112 in order to verify accuracy. If results are 
inadequate, additional exemplar regions may be input using the methods described above. 
New spatial and statistical models are then calculated, and the identification process is 
repeated. This process continues until sufficient quality is achieved, in which case the 
structural parameter is measured and output in step 114. 
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Two experimental applications of this invention are described below. In the first, the 
invention is used to identify, delineate and measure the hippocampus in Tl weighted MRI 
images of normal volunteers. In the second, the invention is used to identify, delineate and 
measure (separately) the lumen and surrounding thrombus in CT images of patients suffering 
5 from abdominal aortic aneurisms. 

The hippocampus is a gray matter structure of the human brain, located adjacent to 
the amygdala and the caudate nucleus and attached to the gray matter of the cerebral cortex. 
See Figs. 3A and 3B, which show, respectively, separation of the right hippocampal head 
from the basal nucleus of the amygdala and separation of the left hippocampal tail from the 

10 tail of the caudate nucleus.. Because the hippocampus is small, tortuous, and lacks clear 
boundaries with several adjacent structures, its identification and measurement is particularly 
difficult. The object of this experiment was to determine the accuracy, speed and precision of 
the system described in this work in identifying and measuring the hippocampus. A data set 
was obtained which consisted of 5 coronal Tl weighted MRI studies taken from normal 

15 volunteers. All volunteers provided informed consent prior to enrollment in this study. MR 
acquisition was 3D, with a slice thickness of 2.5mm. Sample images from this data set are 
given in Figs. 4A-4C for Subject 1, Subject 5 and Subject 10, respectively. 

In order to establish a gold standard and an associated error margin, the hippocampi 
of each subject were identified by four expert analysts using a computer-aided manual tracing 

20 process. The experiment was intended to determine: (1) How many exemplars were required 
to produce an automated measurement that was statistically indistinguishable from a manual 
one? (2) What was the time savings associated with this process, as compared to manual 
tracing? (3) What was the reproducibility of the automated process? 
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In order to answer the first question, the right hippocampus for Subject 1 was 
measured, using a varying number of exemplars for morphological model formation. These 
results were compared to manual measurements of the same structure. 

The results of this experiment are given in Figure 5, which shows a plot of manual vs. 
5 automated volume for hippocampal measurement with varying numbers of exemplars. The 
manual volume + and manual volume - lines represent the mean manual measurement plus 
and minus one standard deviation. In this case, results with four or more exemplars are 
statistically indistinguishable from manual measurements. 

The question of time savings can be answered by examining the number of exemplars 
10 required for adequate results. The hippocampus in this case extended over a total of 16 
images. Because only four were needed as exemplars, time savings should be at least 75%. 
In practice, because the exemplars were defined using single click geometrically constrained 
region growth (Ashton, 1997) time savings were in excess of 90%. 

In the second phase of this experiment, the right hippocampus of each of the five 
15 subjects was analyzed four separate times. The intent in this case was to establish the 
reproducibility of this technique. Results of this experiment are given in Table 1. Clearly, in 
the case of hippocampal measurement this invention provides clear advantages over current 
methods in terms of speed, accuracy, and precision. 

Table 1: Results of hippocampus reproducibility experiment. Numbers are 
20 hippocampal volumes in cubic centimeters. Mean coefficient of variability is 2.14%. This 
compares to reported values of 5% - 7% for manual identification. 





Repeat 1 


Repeat 2 


Repeat 3 


Repeat 4 


Mean 


Std. Dev. 


Coef. Var. 


Subject 1 


3.143 


3.284 


3.183 


3.268 


3.22 


0.68 


2.1% 


Subject 2 


3.34 


3.351 


3.379 


3.154 


3.306 


0.10 


3.1% | 


Subject 3 


3.219 


3.21 


3.27 


3.259 


3.24 


0.03 


0.9% 
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Subject 4 


2.647 


2.836 


2.79 


2.748 


2.755 


0.08 


2.9% 


Subject 5 


3.069 


3.179 


3.132 


3.179 


3.14 


0.05 


1.7% 



The second application of this invention involves identifying and measuring the 
vessels and surrounding thrombus of the abdominal vascular system. Accurate mapping and 
measurement of abdominal aortic aneurisms and the surrounding vasculature is a vital tool 
5 for both surgical planning and patient follow-up. Current manual methods for vascular 
classification are very time consuming, since a typical abdominal CT scan may contain up to 
800 individual images. In this case, the goal of the invention is to provide a result that is 
statistically indistinguishable from a manual identification while enabling a substantial time 
savings. 

10 In order to provide a point of comparison, a substantial section of abdominal 

vasculature and thrombus was identified manually five times. The first identification was 
considered baseline, while the next four were considered repeats. The parameter of interest in 
this case was the number of voxels classified differently on the baseline and each repeat, 
expressed as a percentage of total pixels of a given class in the baseline identification. 

15 Results of this experiment are given in Table 2. 

Table 2: Results of manual vasculature identification experiment. Note that volume 
differences are small relative to pixel classification differences, particularly for thrombus 
identification. 





Repeat 1 


Repeat 2 


Repeat 3 


Repeat 4 


% Lumen Difference 


12.9 


12.8 


14.9 


12.1 


% Thrombus Difference 


43.0 


43.3 


45.7 


44.7 


% Lumen Vol. Difference 


5.4 


10.1 


11.9 


1.3 


% Thrombus Vol. Difference 


5.6 


5.6 


9.2 


15.6 j 
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In order to determine both the accuracy and time savings possible using the method 
described here, a 228 image CT scan was fully identified manually. This identification 
served as baseline. Varying numbers of exemplars were then used until the results fell within 
5 the bounds defined by the previous experiment. 

Results of this experiment are shown in Figs. 6A and 6B. Fig. 6A is a plot showing 
the decrease in differently classified lumen voxels with increasing numbers of exemplars. 
Note that the result is statistically indistinguishable from a manual measurement at 
approximately 50 exemplars. Fig. 6B is a plot showing the decrease in differently classified 
10 thrombus voxels with increasing numbers of exemplars. Note that the result is statistically 
indistinguishable from a manual measurement at approximately 30 exemplars. 

The results of this experiment are quite consistent with those of the hippocampus 
experiment. Results statistically indistinguishable from manual measurement are achieved 
with roughly one exemplar for every four images. This provides a potential time savings of 
15 75% or more, with an accuracy equal to or better than that provided by manual measurement. 

Fig. 7 is a schematic diagram of a system on which the preferred embodiment can be 
implemented. System 700 includes an input device 702 for input of the image data, the 
anatomical atlas, and the like. The input device can, as noted above, include a mouse 703. 
The information input through the input device 702 is received in the workstation 704, which 
20 has a storage device 706 such as a hard drive, a processing unit 708 for performing the 
processing disclosed above, and a graphics rendering engine 710 for preparing the data for 
viewing, e.g., by surface rendering. An output device 712 can include a monitor for viewing 
the images rendered by the rendering engine 710, a further storage device such as a video 
recorder for recording the images, or both. 
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While a preferred embodiment of the present invention has been set forth in detail, 
those skilled in the art who have reviewed the present disclosure will readily appreciate that 
other embodiments can be realized within the scope of the invention. For example, numerical 
values are illustrative rather than limiting, as are disclosures of specific mathematical 
5 formulae. Also, the present invention can be used in the context of any human or non-human 
tissues or in non-biological contexts. Furthermore, the system on which the invention is 
implemented can be part of, or separate from, a scanner or other device for taking image data. 
Therefore, the present invention should be construed as limited only by the appended claims. 
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